CCCP Algorithms to Minimize the Bethe free energy of 3-SAT Problem

نویسنده

  • Yusupjan Habibulla
چکیده

The k-sat problem is a prototypical constraint satisfaction problem. There are many algorithms to study k-sat problem, BP algorithm is famous one of them. But BP algorithm does not converge when α(constraint density)is bigger than some threshold value. In this paper we use CCCP (Concave Convex Procedure) algorithm to study 3-sat problem and we get better results than BP algorithm that CCCP algorithm still converges when BP algorithm does not converge. Our work almost builds on recent results by Yuille [1] who apply the CCCP algorithm to Bethe and Kikuchi free energies and obtained two algorithms on 2D and 3D spin glasses. Our implementation of CCCP algorithm on 3-sat problem is some different from his implementation and we have some different views about CCCP algorithm’s some properties. Some difference of these maybe because of CCCP algorithm have different properties and implementation process on different problem and some others of these are related to the CCCP algorithm itself. Our work indicates that CCCP algorithm has more learning and inference applications.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Convexity Arguments for Efficient Minimization of the Bethe and Kikuchi Free Energies

Loopy and generalized belief propagation are popular algorithms for approximate inference in Markov random fields and Bayesian networks. Fixed points of these algorithms have been shown to correspond to extrema of the Bethe and Kikuchi free energy, both of which are approximations of the exact Helmholtz free energy. However, belief propagation does not always converge, which motivates approache...

متن کامل

An LDPCC decoding algorithm based on Bowman-Levin approximation

Belief propagation (BP) and the concave convex procedure (CCCP) are methods that can be used successfully to minimize the Bethe free energy of graphical models. The mechanisms of these methods, however, have not been well elucidated. We propose a method based on the Bowman-Levin (BL) approximation, which is another equation of the extrema of the Bethe free energy, so that we can compare the mec...

متن کامل

CCCP Algorithms to Minimize the Bethe and Kikuchi Free Energies: Convergent Alternatives to Belief Propagation

This article introduces a class of discrete iterative algorithms that are provably convergent alternatives to belief propagation (BP) and generalized belief propagation (GBP). Our work builds on recent results by Yedidia, Freeman, and Weiss (2000), who showed that the fixed points of BP and GBP algorithms correspond to extrema of the Bethe and Kikuchi free energies, respectively. We obtain two ...

متن کامل

Approximate Inference and Constrained Optimization

Loopy and generalized belief propagation are popular algorithms for approximate inference in Markov random fields and Bayesian networks. Fixed points of these algorithms correspond to extrema of the Bethe and Kikuchi free energy (Yedidia et al., 2001). However, belief propagation does not always converge, which motivates approaches that explicitly minimize the Kikuchi/Bethe free energy, such as...

متن کامل

A Double-Loop Algorithm to Minimize the Bethe Free Energy

Recent work (Yedidia, Freeman, Weiss [22]) has shown that stable points of belief propagation (BP) algorithms [12] for graphs with loops correspond to extrema of the Bethe free energy [3]. These BP algorithms have been used to obtain good solutions to problems for which alternative algorithms fail to work [4], [5], [10] [11]. In this paper we introduce a discrete iterative algorithm which we pr...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • CoRR

دوره abs/1406.4041  شماره 

صفحات  -

تاریخ انتشار 2014